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0> ! Abstract 



Ca{oi) C {x G M : |x - a| = min \x - 

b&an 



Let r, s > 0. For a given probability measure P on R'^, let (a„)„>i be a sequence of (asymp- 
totically) U (P)- optimal quantizers. For all /i e M'' and for every 6* > 0, one defines the sequence 
(a^'^)„>i by ; Vn > 1, a^'^ = + — A*) = {m + ^ ^ ^ Q^n}- I" this paper, we are 
interested in the asymptotics of the L'^-quantization error induced by the sequence (afi'')n>i- We 
»^ ' show that for a wide family of distributions, the sequence (a^'^)„>i is L^-rate-optimal. For the 

, Gaussian and the exponential distributions, one shows how to choose the parameter such that 

(afi'^)n>i satisfies the empirical measure theorem and probably be asymptotically L'^-optimal. 

^ : 1 Introduction 

00 , . 

O ■ Let (r^, A, P) be a probability space and let X : (0, ^, P) — > R be a random variable with distri- 

^ \ bution fx = P- Let a C M'' be a subset (a codebook) of size n. A Borel partition Ca{a)a^a of 

satisfying 

o 

O ■ where | • | denotes a norm on is called a Voronoi partition of (with respect to a and | • |). 

The random variable X" taking values in the codebook a defined by 
• ^ . 

is called a Voronoi quantization of X. In other words, it is the nearest neighbour projection of X onto 
the codebook (also called grid) a. 

The n-L'^'(P)-optimal quantization problem for P (or X) consists in the study of the best approx- 
imation of X by a Borel function taking at most n values. For X G U (P) this leads to the following 
optimization problem: 

en,r(^) =mf{||X-X"||^,aCM'^, card(a) < n} 

with 



= E(d(X,Q))'' = / d{x,aydP{x). 
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Then we can write 

en,r{X) = CnAP) = i^f ([ d{x, a)' dPix)) \ (1.1) 

card(a)<n 

We remind in what follows some definitions and results that will be used throughout the paper. 

• For all n > 1, the infimum in (jl.ip is reached at one (at least) grid a*; a* is then called a 
L''-optimal ?i-quantizer. In addition, if cai-d(supp(P)) > n then card(a*) = n (see [3j or 
[6]). Moreover the quantization error, e„^r-(^), decreases to zero as n goes to infinity and the 
so-called Zador's Theorem mentionned below gives its convergence rate provided a moment 
assumption on X. 

• Let X P and let P = Pa + Ps he the Lebesgue decomposition of P with respect to the 
Lebesgue measure A^, where Pa denotes the absolutely continuous part and Pg the singular part 
of P. 

Zador Theorem (see [3]) : Suppose E|X|''"'"'' < +00 for some t] > 0. Then 

lim n'-Z^ienAnr = Qr{P)- 

n— >+oo 

with 

d+r 

QriP) = Jr,d( [ f^dXd] ' =Jr,d\\f\\^ G[0,+CX)), 

J,,,= infe;,(t/([0,l]'^))G(0,+oo), 

n>l 

where C/([0, l]'^) denotes the uniform distribution on the set [0, l]'^ and / = Note that the 
moment assumption : E|X|''+'' < +00 ensure that is finite. Furthermore, Qr{P) > 

d+r 

if and only if Pa does not vanish. 

• A sequence of n-quantizers (a„)„>i is 

- L'^(P)-rate-optimal (or rate-optimal for X, X ^ P) if 

lim sup n^/'^ / d{x,anY dP{x) < +00, 

- asymptotically L'^(P)-optimal if 

lim n^/'^ /" d{x,anYdP{x) =Qr{P) 
J^d 

- L^(P)-optimal if for all n > 1, 

el,{P)= [ d{x,anYdP{x). 
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• Empirical measure theorem (see [3J) : Let X '-^ P. Suppose P is absolutely continuous 
with respect to and E|X|''+^ < +00 for some 77 > 0. Let (a„)„>i be an asymptotically 
L^(P)-optimal sequence of quantizers. Then 



^Y.5a^Pr (1.2) 



n 

where denotes the weak convergence and for every Borel set yl of M*^, Pr is defined by 

Pr{A) = 7^ / f{x)^dXd{x), With Cf,r = [ f{x)^dXd{x). (1.3) 

• In 0] is established the following proposition. 

Proposition : Let X ~ P, with Pa 7^ 0, such that E|X|''+^ < 00, for some 77 > . Let (a„) 
be an L'^'(P) -optimal sequence of quantizers, b G (0, 1/2) and let ipi, : — > M+ U {+c>o} be 
the maximal function defined by 

Xd{B{x,bd{x,an))) 
'^''^'^ = Ti P{BixMi^,a.))) - ^'-'^ 

Then for every x S M*^, 

Vn > 1, n^/^d{x,an) < C{b)Mx)^^^'^^"'^ (1-5) 
where C{b) denotes a real constant not depending on n. 

• The next proposition is established in [2]. It is used to compute the L'^-optimal quantizers for 
the exponential distribution. 

Proposition Let r > and let X be an exponentially distributed random variable with scale 
parameter A > 0. Then for every n > 1, the L*^ -optimal quantizer an = (onij • • • , ctnn) is 
unique and given by 

n-l 

anfc = Y + '^<k<n, (1.6) 

i=n+l— fc 

where {ak)k>i is a M+-valued sequence defined by the following implicit recursive equation: 

ao := +00, (j){-ak+i) := (piak), k>0 

with (j){x) := Jq^"^ \uY~^sign{u)e~^ du ( convention : O'^ = 1). 
Furthermore, the sequence {ak)k>i decreases to zero and for every A; > 1, 

for some real constant Cr- 
NOTATIONS 

• Let an be a set of n points of . For every /i G M"^ and every ^ > we denote 

Oin^ = A* + G{cin - fi) = {fi + 8{a - fi), a G a„}. 
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• Let / : M"' — > R'^ be a Borel function and let fi > 0. One notes by /g,^ (or fe if 
/i = 0) the function defined by fe,^i{x) = /(/U + 6{x — fi)), x G M'^. 

• If X P, ^ will stand for the probability measure of the random variable + n, > 
0, fi G In other words, it is the distribution image of P by x i — > ^^-^ + fx. Note that if 
P = f ■ Xa then P^,^ = /e,^ • A^. 

• If yl is a matrix A' stands for its transpose. 

• Setx = (xi,-- - ,Xd); y = {yi,--- ,yd) G M"*; we denote [x,y] = [xi,yi] x ••• x [xd,yd]- 

Definition 1.1. A sequence of quantizers {Pn)n>i >s called a dilatation of the sequence with 
scaling number 6 and translating number fi if for every n > 1, (3n = , with 6 > 1. If < 1, 
one defines likewise the contraction of the sequence (a„)„>i with scaling number 9 and translating 
number fi. 

2 Lower estimate 

Let r,s>0. Consider an asymptotically L^(P)-optimal sequence of quantizers {an)n>i ■ For every 
IJ, and every > 0, we construct the sequence (on ^)n>i and try to lower bound asymptotically 
the -quantization error induced by this sequence. This estimation provides a necessary condition of 
rate-optimality for the sequence (an^)„>i. Obviously, in the particular case where 9 = 1 and /x = 
we get the same result as in 0] , a paper we will essentially draw on. 

Theorem 2.1. Let r,s ^ (0, +cxo), and let X be a random variable taking values in with distribu- 
tion P such that Pa = f.Xd ^ 0. Suppose that K\X\'^'^^ < oo for some rj > 0. Let (a„)„>i be an 
asymptotically {P)-optimal sequence of quantizers. Then, for every 9 > and every fi G W^, 

liminf n"/'^ \\X - > QI%{P,9), (2.1) 

n— >+oo ' 

with 

g^';{(p,0) = r+^j,,df / f^dx^) [ fe,^r^dXd. 

KJM.d J J{f>o} 

Proof. Let m > 1 and 

m2'"-l , 
A:,/=0 

with 

= < / < ^} n P(0,m) and Cr = < h,, < ^} n P(0,m). 
The sequence (/m'^)m>i is non-decreasing and 

m— >+oo 
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Let 

Im = {(A;, /) G {0, • • • , m2- - l}^ : \^{E^) > 0; \d{GT) > 0}. 
For every {k,l) G /,„ there exists compact sets i^™ and such that : 

Kr C Er ,LrcGr, XdE^KD < and UGT\LT) < 



Then 



Consequently, 



{^E'^r^GT)\{K^r^LT) = E^ n Gf n {{Kry U (1^ 

c (i?rw)u(Gr\Lr). 



Ad(^rnGrwnLr) < xdEr\Kn + UGr\Lr) 

1 1 

- ^422m+l + j^422»n+l 
1 



For every m > 1 and every (A;, Z) G I^, set 



and 



k,l=0 



m2™'-l ^ 
k,l=0 



We get 

k,lG{0,--- ,m2™-l} 

Therefore, for every m > 1, 

Xd{{fm^ / /m^}) < ^422m = 

fc,/=0 

and finally 

m>l 

As a consequently Ad(dx)-p.p, fm^{x) = fm^{x) for large enough m. Then /m^ • j^^^ when 
m ^ +00. Since in addition A^^ C -E™ n G[" we obtain 

f^" < f?f < fe,.. (2.2) 
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Moreover, for every n > 1, 

^./d ||x - = n^/-^ / d{z,f, + eian + fi)rfiz)\didz) 

> n'/'^ f ul\n\z-{^l + e{a- ^l))\'f{z)\d{dz) 



> e'n''^ uAn\{z- ^x)/e + n-a\'f{z)\d{dz). 
Making the change of variable x := {z — fi)/9 + yields: 

> e^+^n'/" [ d{x,anrf^^Xd{dx) ( by Q ) 

m2™-l , „ 

= r+V/-^ V — / d{x,anrXd{dx). (2.3) 

Z I Am 

k,l=0 ^k,l 

Let m > 1 and {k, I) G /„. Define the closed sets by Ji™; = if Ad(Ji^;) = and otherwise by 

where £ (0, 1] is chosen so that 

f^dXd<{l + l/m) [ f^dXd. 



Since is compact (AJf, C -6(0, m + 1)) V(A;, /), there exists ( ref. (Q, Lemma 4.3) a finite 
" firewall" set such that 

Vn>l, Vxei^,, d(x,a„U/3^;) = d(x,(a„U/3^,)ni^;). 

The last inequality is in particular satisfied for all x G A^j^ since A^^^ C A^^. 

Now set = IJ^ ; (3^1 and n™^ = card((a„ U /J*") n A^i)- The empirical measure theorem (see 
dni)) yields 

card(a„ n i^^) L„nA™ /^'^^rf /a- /^"^^^ 

lim sup — = '— < '■ — 2 • 

n Jf^dXd Jf~dXd 

card(«„ni-) 
— - ~ — when n — > +oo 

n n 

liminf ^ > ^^^/'^ > ^^^/''^ ■ (2.4) 



Moreover 



then 
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In the other hand, 

d{x,anyXd{dx) > I (a„ U n ^^,)"Arf(dx) 



Xdjdx) 



where U{A) = \A/Xci{A) denotes the uniform distribution in the Borel set A when Xd{A) ^ 0. Then 
we can write for every {k,l) G Im, 

liminfn^/-^ / d{x , anf Xd{dx) > A,(A^,) liminf ( ^] liminf n^/'^a^,,([/(A^,)), 



Since 



liminf n^/'^e^,,(C/(A^,)) > J,,, • A,(A^,)^/'^. 

n 1 I > : 

Owing to Equation (|2.4p . one has 



s/d 



n— >+oo 



liminfn^/'^ / d{x , anY Xdidx) > XdiA 



k,V 



k.l 



r 

m J f'^+'-dXd 
["^^'h-f^dXd^ 



js,d-XdiAf,r/'. 



However, on the sets A^^, the statement 4 > (^^) ^ holds since / < on E^. Hence 



liminfn^/'^ / d{x , UnY Xd{dx) > Jg^ 



m+l f d , 

fd+^Xdidx^ 



m 



s/d 



k + l\ d+r-d 



XdiAT,). 



It follows from Equation ()2.3p and the super-additivity of the liminf that for every m > 1, 



liminfn"/'^ llX-X^^-^llf > r+'^Js d ( ^^^^ 
n ' \ m 



f^Xdidx) Yl 



I fk + l 



k,l=0 



m \ om 



d+r 



Xd{A?,) 



m 



fd+rXd{dx) 



s/d 



{/>0} 



Finally, applying Fatou's Lemma yields 



liminf n^/'^ ||X - > r+'^J,,^ f / /^dA^) ^ /" /e,;./-^dAd 

"^+~ ViRd / Jif>0} 



□ 



3 Upper estimate 

Let r,s>0. Let (a„)„>i be an (asymptotically) U{P) - optimal sequence of quantizers. In this sec- 

On 

tion we will provide some sufficient conditions of L*(P)-rate-optimality for the sequence (an )n>i- 
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Definition 3.1. Let ^ > 0, /i G M'^ and let P be a probability distribution such that P = f ■ Xd- The 
couple {6, fi) is said P-admissible if 

{f > c - d) + d{f > ^] Xd-p.p. (3. 1) 

Theorem 3.1. Let r,s£ (0, +oo), s < r and let X be a random variable taking values in with 
distribution P such that P = f ■ X^. Suppose that (9, ^) is P-admissible, for > 0; € M, and 
]g|j^|r+7? ^ for some tj > 0. Let (an)n>i be an asymptotically L"^ -optimal sequence. If 

I ft:r^^dXd < +00 (3.2) 
then, {an^)n>i is {P)-rate-optimal and 

limsupn^/-^ ||X - < {Qr{P)f'' i I ff^F'^^dX^ ' . (3.3) 

n^+oo \J{f>0} J 



Remark 3.1. Note that if 9 = 1 and p, = then 

ft:r^'dXd=f f^r^dXd= [ fdXd = i. 

{/>0} ''^ J{f>0} J{f>0} 

In this case the theorem is trivial since \\X — X°'" \\s < \\X — X"" ||,.. 

Proof. Let P^ denotes the distribution of tiie random variable 9X. P^ is absolutely continuous with 
respect to A^, with p.d.f ge{x) = 9~'^f{f). 
For every n > 1, 

n'/^\\X -X^^'^Wl = n'l'^ f d{x,a^^^'ydP{x) 



/ mm\x - fi{l - 9) - 9a\'^f{x)dXd{x). 



'{/>o} 

Making the change of variable z := x — p{l — 9) yields 

n'^/d \\x - 1""" 11^ = n'/'^ I d{z, 9anyf{z + //(I - 9))dXd{z) 



<n''^ d{z,9anyf{z + fi{l-9))g^\z)dP^{z) (3 

Je{f>o} 

< n'l" { [ d{z, 9anYdP'{z)) ' ( / {f{z + - 9))g-\z)) ^dP'{z)] 
KJR'i J V^e{/>o} / 

r — s 

<(n^/''\\9X-9x'''"\\:Y^[[ f{z + f,{l-9))^sg-^^^,)dXd{z)] ' 
^ ^ \Je{f>o} J 

where we used the P-admissibility of {9, p) in the first inequality. The second inequality derives from 
Holder inequality applied with p = r / s > 1 and q = \ — s/r. 
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Moreover 

\\ex -ex'^'^"\\'!; = E(mm\ex -Ban = (3-5) 

Then 



n 



^ ^ \^e{/>o} 



Owing to the asymptotically L''(P)-optimality of (a„) and making again the change of variable x :- 
z/9 yields 



limsupn"/'^ \\X - X"'"'^''' \\l < 9' {Qr{P)y^'' { / f {z + ^{1 - 6)))^- f {z / 9)' dXa{z) 

n->+oo \ J8{f>0} 



■9^Qr{P)f'- { 9^s / /,,^(x)^/(x)^^dA,(x) 

r ■ 

V-^{/>0} / 



□ 



When s > r, the next theorem provides a less accurate asymptotic upper bound than the previous 
one since, beyond the restriction on the distribution of X, we need now the sequence (a„) to be 
(exactly) L''(P)-optimal. 

Theorem 3.2. Let r,s(z (0, +cxo), s > r, 9 > and let X be a random variable taking values in 
with distribution P such that P = f ■ X^. Suppose that ¥\XY'^^ < oo for some r] > and Pg^fj, <C P 
[i.e Pq ^j^ is absolutely continuous with respect to P ^ for some € R'^. Let (an)n>i L^\P)- 
optimal sequence of quantizers and suppose that the maximal function (see \L4\ ) satisfies 



^s/{d+r) ^ L^(Pg^^) for some b G (0, 1/2). (3.6) 

Then, 

limsupn*/'^ \\X - < r+'^C7(6) / f0,f,f~^dXd < +oo (3.7) 

n J 

where C{h) is a positive real constant not depending on 9 and n. 

Notice that this theorem does not require that {9, fi) is P-admissible. 
Proof. One deduces from differentiation of measures that 

f-iT^ < i^f^ P9,^.-a.s. 

Then, under Assumption ()3.6p . 

j f-^dPe,f, = j fe,f.r^^dXd < +00. 
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For all n > 1, 

= n mill \[z — ^)/9 + n — a\^ f {z)d\d{z) 

We make the change of variable x := {z — fi) / 6 + fi. Then 

n^/'^ = n'/'^e'+^ [ d{x,anyf{fi + e{x-fi))dXd{x) 

= n^Z-^r / dix,anrdPe,^,ix). 

Besides, the following inequalities are established in ^ : 

limsupn'*/'^d(-,a„)' < C{h)r^ 

n 

and n '/'^d{-, OnY < C{b)ip;^+'- P-as (hence Pe,^-a.s., since Pg^^ < P). 



Under Assumption ()3.6p we can apply the Lebesgues dominated convergence theorem to the above 
inequalities, which yields 

limsupn*/ / d{x , dPg ^^{x) < / limsupn '/'^dix, an YdPg^x) 
n J J n 

< C{h) j r^dPe,f,{x). 

= e^Cib) j feA^)f-^{x)dXd{x). 

□ 

For a given distribution. Assumption ()3.6p is not easy to verify. But when s 7^ r + d, the lemma 
and corollaries below provide a sufficient condition so that Assumption p.6p is satisfied. The next 
subject extends the results obtained in (0]). For further details we then refer to (0]). 

Let P = / • Arf be an absolutely continous distribution. Let r, s G (0, +00) and {9,fi) be a 
P-admissible couple of parameters. We will need the following hypotheses: 

(HI) for all M > 0, 

™p ^"'-^;,"-"» Wo,<+oo. (3^8) 



(H2) There exists 6 G (0, 1/2), Me (0, +00) such that 

s/{d+r) 

,<X.| P{B{x,t)) 



Ib{ 



«UP I dPe,, < +00. (3.9) 



(H3) Xd{- n supp(P)) <^ P and supp(P) is a finite union of closed convex sets. 
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Lemma 3.1. Let P = f ■ and r > such that J \x\'^P{dx) < +00. Asswne (an)n>i sequence 
of quantizers such that J d{x,anYdP 0. Let {6,fi) be a P-admissible couple of parameters for 
which {HI) holds. 

(a) Ifp E (0, 1) then for every 6 > 0, < G Lj^Pe,,,). 

(b) Ifp G (1, +00] and if furthermore (H3) holds then for every b > 0, 

f-P G lUp) ^ < G L^Pe,^). 

Proof. It follows from the P-admissibility of fi) that 

Pe,^{dz) = e^'fifi + e{z - f,))Xd{dz) = ge{z)P{dz), 

where geiz) = 9^ fif^+^i^~f^)) 1|j(..)^q-}.. Then is locally bounded by (HI). 

(a) If p G (0, 1), it follows from Lemma 1 in g] that ipl G Ll^^{P). Hence ipl G L}^^{P0^fj_) since 
gQ is locally bounded. 

(6) If p G (1, +00) it follows from Lemma 2 in |4j that if f'P G Aoc(-P) *en G L/„^(Pe,^) 
since gg is locally bounded. 

□ 

Corollary 3.1. (Distributions with unbounded supports ) Let r > 0, s G (0, +00), s ^ r + d and 
let X be a random variable with probability measure P = f ■ such that E\XY^'^ < +00 for some 
rj > 0. Let (9, /i) be P-admissible and suppose that (HI), (H2) hold. 

(a) If s £ (0, r + d) then Assumption l\3. 6\i of Theorem \3. 2\ holds true. 

(6) If s G (r + d, +00), and if furthermore, (H3) holds and f G Lf^^{P) then Assumption 
()j.6p of Theorem \3.2\ holds true. 



Proof. Let xq G supp(P). We know from {l} that d{xo,an) 0. Then following the lines of the 
proof of Corollary 2 in 0] one has for |x| > = |a;o| +sup„>]^ d{xo, an), d{x, a„) < 2\x\ for every 
n > 1. Thus for every 6 > 0, x G B{0, N)", 

Xd{B{x,t)) 

ipb{x) < sup 

t<2b\x\ P{B{x,t)) 

Now, coming back to the core of our proof, it follows from (H2) that (for b coming from (H2)), 



i^f'^'^dPe,, < +00. 



Since 



B{0,MVAf)': 



IB{0,MVN) JB{0,MVNY 

it remains to show that the first term in the right hand side of this last equality is finite. 

(a) If s G (0, r + d) it follows from Lemma [3TT| (a) that the first term in the right hand side of 

s ^ 

the above equality is finite. As a consequence, ipr+d g L (Pq^^). 

(b) If s > r + d, the first term in the right hand side of the above equality still finite owing to 
Lemma im (6). Consequently, Assumption (\3.6\i of Theorem l3.2l holds true provided (H3) holds and 

/-^ G LjjP). 

□ 
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We next give two useful criterions ensuring that Hypothesis (H2) holds. The first one is useful 
for distributions with radial tails and the second one for distributions which does not satisfy this last 
assumption. 

Criterion 3.1. Let X be a random variable with probability measure such that P = f ■ and 

E\X\^'~^^ < +00 for some r] > 0. 

(a) Let r,s > and f = h{\ ■ \) on B\.\{0, NY with h : {R, +00) M+, R G M+, a decreasing 
function and \ ■ \ any norm on W^. Suppose that {9,fj,) is a couple of P -admissible parameters such 
that 

j ficxr^dPe,^,ix) < +00 (3.10) 

for some c > 1. Then (H2) holds. 

(6) Letr,s > 0. If supp{P) C [Rq, +00) for some Rq £ ]&and f^^j^i decreasing for Rq > Rq. 
Assume furthermore that {9,fj,) is a couple of P -admissible parameters such that <\3.10\) is satisfied 
for some c > 1. Then Hypothesis (H2) holds. 

Note that (6) follows from (a), for d = I, and that (a) is simply deduced from the proof of 
Corollary 3 in [4] since it has been showed that for b G (0, 1/2), M := N/ (1 — 26) one has for every 

X G 5(0, M)^ 

Xd{Bix,t)) ^ 1 



il^^l Pmx,t)) /(x(l + 26))- 

Criterion 3.2. Let r, s > 0, P = f ■ Xd and J \x\^~^'^ P{dx) < -\-oo for some r] > 0. Let {9, fi) be a 
P-admissible couple such that 

? ^"%(i)"''" w.|<+c.. (3.11) 

z^O J{Z) 



Assume furthermore that 



. Xd{supp{P)nB{x,p)) 

w777 \\ > 

x&uppiP),p>o Xd[B[x,p)) 



and that f satisfies the local growth control assumption : there exists real numbers £ > 0, rj € 
(0,1/2), M,C > such that 

yx,ye supp{P), \x\ > M, \y-x\< 2r]\x\ =^ f{y) > Cf{xY+^. 

If 

J f{x)-'~^dP{x) < +00, (3.12) 

then (H2) holds. If in particular f satisfies the local growth control assumption for e = or for every 
£ G (0, e], with e > 0, and if 

/ f{x)~^dP{x) = / f{xf~^dXd{x) < +00 
J J{f>0} 

then Hypothesis (H2) holds. 



Notice that Hypothesis p.l ip can be relaxed if we suppose that /(x) G L^{P0^^) instead 

of (j3.12p . The criterion follows from Corollary 4 in 
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4 Toward a necessary and sufficient condition for (P) -rate optimality 
when s > r 

Before dealing with examples, let us make some comments about inequalities (|2.ip and p.7p . Note 
first that the moment assumption E|Xp'+'' < +00 for some > 0, ensure that j^a f'^+''dXd < +00 
(cf IS). Consequently, if J fe,iif~~ d^d = +00 one derives from inequality ()2.ip that 

lim||X -X"""!!* = +00. 

n 

Then the sequence (a°'^).„>i is not L*-rate-optimal. 

On the other hand if / fe.ij.f~'^ dXd < +00 one derives from Inequality ()3.7p that {an^)n>i 
is L^-rate-optimal. For s > r, this leads to a necessary and sufficient condition so that the sequence 
(ctn )n>i (in particular the sequence {an)n>i by taking 6 = 1 and /i = 0) is -rate-optimal. 

Remark 4.1. Lef /i G M'^, ^, r > 0, s > r anJ let P be a probability distribution such that P = f-X^. 
Assume {6,^) is P-admissible. Let {an)n>i U'{P)-optimal sequence of n-quantizers and 

suppose that Assumption ()j.6p of Theorem \3.2\ holds true. Then 

{a^^'')n>i is L" -rate-optimal <^ / fg^f,f~^ dXd < +00. (4.1) 



Remark 4.2. If s < r, the inequality (jJ. provides a sufficient condition so that the sequence 

{oin^)n>i is -rate-optimal, which is : J fg^" f~^^dX(i < +00 (always satisfied by (an)n>i 
itself). 

Now, for s / r, is it possible to find a 9 = 9* for which the sequence (on )n>i is asymptotically 
L^(P) -optimal? (when s < r this is the only question of interest since we know that (q;„)„>i is 
-rate-optimal for every s < r). 
For a fixed r, h and /x, we can write from inequalities p.3p and (|3.7p : 

limsup n'/'^ \\X- X""" ||^ < Q^;P(P, ^) (4.2) 

n 

with 

One knows that for a given s > 0, we have for all n > 1, 

e^,,(X)<||X-l-""||^ 

Then for every ^ > 0, 

Qs{P)<Q^':!{p,e). 

Consequently for a fixed s > 0, in order to have the best estimation of Zador's constant in L^, we 
must minimize over 9, the quantity Q^^i{P, 6). In that way, we may hope to reach the sharp rate of 
convergence in Zador Theorem and so construct an asymptotically L^-optimal sequence. 

For /i well chosen, the examples below show that, for the Gaussian and the exponential distribu- 
tion, the minimum 9* exists and the sequence {an '^)n>i satisfies the empirical measure theorem and 
is suspected to be asymptotically L*-optimal. 



13 



5 Examples 



Let (a„)„>i be an L''(P)-optimal sequence of quantizers for a given probability distribution P, and 
consider the sequence (a„''')n>i- For a fixed ^ and s, we try to solve the following minimization 
problem 

r = argmin {Ql"!iP, 6), (a^''')n>i -rate-optimal). (5.1) 

In all examples, C will denote a generic real constant (not depending on 9) which may change 
from line to line. The choice of fi depends on the probability measure and it is not clear how to choose 
it. In practice, we shall set = K{X) when X is a symmetric random variable otherwise we will 
usually set /i = 0. 

5.1 The multivariate Gaussian distribution 
5.1.1 Optimal dilatation and contraction 

Proposition 5.1. Let r,s>0 and let P = M{m; S), m G M'^, S G cS+(d, R). 

(a) If s G (r, r + d) U (r + d,+co), the sequence (an'")n>i L'^{P)-rate-optimal iff 6 & 
{^yj s/{d + r), +oo) and 

r = V(s + d)/(r + d) G (l,+oo) 
is the unique solution of ()5.ip on the set {^^Js/{d + ^r), +oo) . 

(b) If s G (0,r), the sequence (a^'™')„>i is L^{P)-rate-optimal if 6 & (y^s/r, +oo) 
and 

= v^(JTd)7(7Td) G (0, 1) 

is the unique solution of ()5.ip on the set (^y^s/r, +oo) . 

Proof. Since the multivariate Gaussian distribution is symmetric, one sets fi = m. Keep in mind that 
the probability density function / of P is given for every x £ by, 

f{x) = ((2^)'^det s)~5e-i(^-m)'s-i(x-m)_ 

Note first that Hypothesis (HI) is obviously satisfied from the continuity of f(™+j^(^-"^)) l^f(^z)>o} on 
every ^(0,M), M > 0. 

(a) Let s G (r, d + r). For every > 0, /x G W^, the couple {9, /i) is P-admissible (/ > 0) and / 
is radial since f{x) = ip{\x — m|s) with : (0, +oo) i — > M+ defined by 

¥^(0 = ((27r)'^detS)"^/^exp(-i|eP), with = 

Let 9 > y^s/{r + d). Then Assumption (j3.10p holds for every c G {1,9^J^^). Consequently, it 
follows from Corollary 13. 11 (a) that Assumption (|3.6p of Theorem l3.2l holds. 

If s > d + r, the required additional hypotheses (H3) and / G L\^^{P) are clearly satisfied 

1 — ^ 

since P = f ■ (and is continuous ensuring that Ad(-nsupp(P)) <^ P) and / '^+'* is continuous 
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on every B{0, M), M > 0. Then it follows from Corollary l3.lt (6) that Assumption ()3.6p of Theorem 
Oholds. 

In the other hand 



fe,m{x)f{x) 'i+^dx = / f{m + 9{x — m))f{x) 'i+^dx 



so that 



/ fe,m{^)fix) '^+'- < +00 iff e > 



s 



d + r 



Now we are in position to solve the problem ()5.ip . Let 9 G (^y^s/{d + r), +cxo) , 



{{27ry det ^2 



d 

S N 2 



(i + r 

For 6* € ( \/s/{d + r), +00) , we want to minimize the function h defined by 



hi9) 



s+d / n2 



d + r 



The function h is differentiable on ( y^s/{d + r), +00) with derivative 



V d + ry V r + d) 



One easily checks that h reaches its unique minimum on (^^Js/{d + r), +00) at 0* = ^J{s + d)/{r + d). 
(b) Let s < r and consider the inequality ()3.3p . We get 



/;;„^(x)/-^(x)dx = c / ^-,v^sis'-^r)i---)'^~'i-^)dx. 



So if 6* G (^y^s/r, +00) then J fgrn(^)f < +00. This proves the first assertion. 

To prove the second assertion, let 9 G (\/s/r, +00). Then 



We proceede as before setting 

h(9) = r (9^ --Y , with a = d + s and (3 = - — (r - s). 
\ r / 2r 
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For all 9 G [^/sJr, +00), 

h'{e) = e-^ (e^-'^'" ((a + 2/3)^^ - ^) . 

The sign of h' depends on the sign of ((a + 2(3)6'^ - Moreover q + 2/3 = f (d + r) > then 
h' vanishes at 9* = \/ {s + d) / {r + d), is negative on the set (^y^s/r, 6*) and positive on (^*, +cxo). 
Therefore h reaches its minimum on {\/s/r, +cxd) at the unique point 9*. 

□ 

Remark 5.1. Let X ~ J\f{m; S). 

If s < r, then 9* < 1. Hence, {an ''")n>i is a contraction of (an)n>i with scaling number 9* 
and translating number m. In the other hand, if s > r, then 9* > 1. In this case the sequence 
{an '™)n>i is (I dilatation of {an)n>i with scaling number 9* and translating number m. Also note 
that 9* does not depend on the covariance matrix S. 

What we do expect from the resulting sequence {an ''")n>i ? The proposition below shows that it 
satisfies the empirical measure theorem (keep in mind that this theorem is satisfied by asymptotically 
optimal quantizers although the converse is not true in general). 

Proposition 5.2. Let r,s > and let P = AA(m; S). Assume (an)n>i is asymptotically L^{P)- 
optimal. Then the sequence {a^ ™)n>i (<^s defined before with 9* = y^{s + d)/{r + d)) satisfies the 
empirical measure theorem. 

In other words, for every a,b ^ M"^, 

1 o-k m 1 / d 

-card{{x e a^' n [a,b]}) — > — — / f{x)'i+'>dx. 

n (^f,s J[a,b] 



Proof. For all n>l, 

{x G Q.^*''" n [a, 6]} = {x G a„ n [{a - m) /9* + fi,{b- m) /9*] + m}. 

Since (a„)„>i is asymptotically L^-optimal; by applying the empirical measure theorem to the se- 
quence {an)n>i, we obtain: 

-card({x G a„n[(a-m)/6'*+m, {h-m) / 9* +m]}) — > j f{x)^dx. 

"n Cf>,. J[(a-m)/e*+m,{b-m)/e*+m] 

It remains to verify that 



1 



f{x)<i+rdx = — — / f{x)'i+^dx. 



Cf,r J [(a-m) /B* +m,{b-m)/e* +m] Cf^g J[a,b] 

Remind that 

f{x) = ((27r)'^detS)"^e-5(^-™)'S"'(^-™) 



and see (ll.3 



[ /(^ 



d 

Cfr= f(x)'i+^dx. 
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f{z) — dz = -^{e*y f{{x-m)/e* + m)^dx. 



d , , d , , ,1 ( _d_ d 



Hence, for all r > 0, 

Cf^r = ((27r)^det T)W+r) (^^j ' 

By making the change of variable x = m + 6*{z — m), one gets : 

If d 1 

TT- / f{z)d+rdz = — , 

^f,r J[{a~m)/9*+m,{b~m)/e*+m] ^f,r J[a,fe] 

It is easy to check that 

(/((x-m)/r + = (/(x))^((27r)'^det s)"^^^"^ 

and that 

-^(r)-'^((27r)'^detS)~5(dTf-dTi) = ((27r)'^detS)~5{^ ( ) 
Cf^r V " / 

The last term is simply equal to We then deduce that 

If d 1 /• d 

— — / f (x) d+r dx = f{x)d+^dx. 

^f,r J [{a-m) /0* +m,{b-m)/e* +m] ^f,s J[a,b] 



□ 



We have just built a sequence (q;„ '"^)n>i verifying the empirical measure theorem. The question 
we ask know is : is this sequence asymptotically L^'-optimal? The next proposition shows that the 
lower bound in (|2.1|) is in fact reached by considering the sequence {an '™)n>i- 



Proposition 5.3. Let s > and let 9 = 9* = (s + d) /(r + d). Then, the constant in the asymptotic 
lower bound for the error induced by the sequence {an '™)n>i (^^^ ()2. 7 p ) satisfies : 

Qi^/{P,9*)=Qs{P). (5.2) 

Proof. Keep in mind that if P ~ J\f{m; S) then, for all r > 0, 

d+r 

We have in one hand 

s/d / , J f \ s/d 



y f^r[x)d{x)^ = (^((27r)'^detS)~^^ ^ e-^^^"-"^)'^"'^"-"*)^^^ 

= (^((27r)'^detE)5^(^)^y^' 

and in the other hand 

fe\Mr^^{x)d{x) = ((2^)'^detS)~^~^ / e-l^^-"^)'^'^^^-^) dx 



((2^)'^det 
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Combining these two results yields 



d+s 



□ 



After some elementary calculations, it follows from the proposition above and inequalities ()2.ip . (|4.2p . 
the corollary below : 



Corollary 5.1. Let X ~ AA(m; S) and 9* = ^ {s + d) / {r + d). Then, 
Qs{Pf'' < liminf Ji^/"^ \\X - X""*'""!!, < limsupn^/"^ \\X - X""*'"!], < Q^f (P,^)^/" (5.3) 

n— »oo ' 

with 



n— >oo 



s + d 1 J_ 



C(6) ((2^)'^Jf'?S)5(3+^ ifs>r. 

Remarks.!, (a) Tfs > r, we cannot prove the asymptotically {P)-optimality of {an '"^)n>i M«'?ig 
()j.7p i/nce f/ze constant C(b) is not explicit. 

(b) When s < r, the corollary above shows that the upper bound in jp does not reach the 
Zador constant. Then our upper estimate does not allow us to show that the sequence {an '™')n>i i^ 
asymptotically L^{P) -optimal. 

Moreover, using Holder inequality (with p = r/{r — s) and q = r/s),we have for every 6 > 0, 

feA^)r'^i^)dUx) = [ f e Ax) {x)f^){x)dXd{x) 



< (/ — (x)(iA,(x)) (/ f—{x)dX, 



and (for d = 6*) 



d 



f0*A^)f~'^i^)dUx) = ^J^^ feV;{x)r — {x)dXd{x)j ^J^^ f^{x)dXd^ 

J ^^^^^ 

Hence, according to ()5.2p . one gets for every s < r. 



( 1 — a 
/ /jr;(x)r^(x)(iA,(x)) " ii/r_t = q,(p). (5.5) 
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Thus, to reach the Zador constant in ()3.3p we must rather have Jg^d instead of Jr^d (which will be 

lis llr 

coherent since for all s < r, JJ^ < J^ \j^), that is, 

( r-3 
/ ft:{x)r^s{x)d\d{x)] ^ ii/r_^. 

5.1.2 Numerical experiments 

For numerical example, supppose that d = 1 and r G {1, 2, 4}. Let X ~ M{0, 1) and, for a fixed 
n, let an,r = {xi,r, • • • 5 Xn,r} be the n-L''-optimal grid for X (obtained by a Newton-Raphson zero 
search). For every n G {20, 50, ••• ,900} and for (s,r) = (1,2) and (4,2), we make a linear 
regression of Un.r onto an,s '■ 

Xi^s — ^sr-^i^r ~1~ ^srj ^ — I5 * * * 5 ^* 

Table [U provides the regression coefficients we obtain for different values of n. We note that when n 
increases, the coefficients dgr tend to the value ^(s + l)/(r + 1) = 6* whereas the coefficients bgr 
almost vanish. For example, for n = 900 and for (r, s) = (2, 1) (resp. (2, 4)) we get dsr = 0.8170251 
(resp. 1.2900417). The expected values are ^273 = 0.8164966 (resp. y/5/3 = 1.2909944). The 
absolute errors are then 5.285 x 10~ (resp. 9.527 X 10^"^). We remark that the error mainly comes 
from the tail of the distribution. 



n 


ai2 


bi2 


e 




«42 


h2 


e 


20 


0.8250096 


1.826E-14 


0.0003025 




1.2761027 


-3.650E-12 


0.0008607 


50 


0.8211387 


- 1.021E-13 


0.0006870 




1.2828110 


3.733E-10 


0.0020110 


100 


0.8193424 


8.693E-14 


0.0009909 




1.2859567 


4.059E-09 


0.0029445 


300 


0.8177506 


- 1.045E-11 


0.0013601 




1.2887640 


0.0000004 


0.0041021 


700 


0.8171428 


-7.219E-11 


0.0015111 




1.2898393 


- 0.0000089 


0.0048006 


800 


0.8170775 


-6.725E-11 


0.0015247 




1.2900041 


0.0000216 


0.0040577 


900 


0.8170251 


4.564E-11 


0.0015346 




1.2900417 


- 0.0000141 


0.0048182 



Table 1 : Regression coefficients for the Gaussian. 



The previous numerical results, in addition to Equation (|5.2p . strongly suggest that the sequence 
{an '"^)n>i is in fact asymptotically L'^(P)-optimal. This leads to the following conjecture. 

Conjecture 1. Let P ~ J\f{m;Yl) and let (ari)n>i cin U' {P)-optimal sequence of quantizers. 
Then, for every s > 0, the sequence {an '™')n>i (with 9* = {s + d)/{r + d)) is asymptotically 
{P)-optimal. 

5.2 Exponential distribution 

5.2.1 Optimal dilatation and contraction 

Proposition 5.4. Let r, s > and X be an exponentially distributed random variable with rate 
parameter A > 0. Set fj. = 0. 
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(a) T/'s S (r, r + l) U (r + l,+oo), the sequence {an^)n>i is -rate-optimal iff 9 ^ {s/{r + 
1), +00) and 

r = (s + l)/(r + l) 
is the unique solution of ()5.ip on the set i^s / {r -\- 1) , +00) . 

(b) If s G (0,r), the sequence {an^)n>i is L'^ -rate-optimal for all 9 G (s/r, +00) 

r = (s + l)/(r+l) 
the unique solution of ()5.ip on (s/r, +00) . 

Proof, (a) Let s G (r, r + 1). For all > 0, ;U G M'^, the couple {9,p) is P-admissible and the 
function / is decreasing on (0, +00). For 9 > s/(r + 1), Assumption p.lOp holds true for every 
cG (1,^(1 + r)/s). Moreover, Hypothesis (HI) is clearly satisfied. Consequently, if follows from 
Corollary 13.11 (a) that Assumption (\3.6\i holds true. 

If s > r + 1, Assumption ()3.6p still holds since the additionnal assumptions (H3) and / G 
L\^^{P) required to apply the corollary 13. H (6) are satisfied. 

In the other hand, one has 

r r+00 

/ f{9x)f{x)-'/^''+^Ux = C e-^(^-^/(''+^»^dx < +00 <^ 9 > s/{r + 1). 
Jm Jo 

Now, let us solve the problem (jS.ip For all 6* > s/(r + 1), 

r r+oo 

9'+^ / f{9x)f{xy^dx = C9'+^ / e~^(^~^)^(ix 
Jr Jo 

= C 9'+^ ( 9 



r + 1 



Let 



Then 



h{9) = 9 



h'{9) = s9' 



1 

r + 1 
2 



s + 1 



r + ly V r + 1 



Hence, /i reaches its unique minimun on (s/(r + 1), +cxd) at 0* = (s + l)/(r + 1) 
(b) Let s <r. Then 



Jr Jr+ 



r s 

Then, for all 9 > s/r, />— » {9x)f {x)dx < +cxd. This gives the first assertion. 
For all > s/r, then 



C 6*^+^ (r0 - s) 
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We easily check that the function h{9) = 6^^ {rO — s) ^ reaches its minimum on (s/r, +00) at the 
unique point 0* = {s + 1) / {r + 1). 

□ 

Remark 5.3. Let X ~ If s < r, then 9* = (s + l)/(r + 1) < 1. Hence, the sequence 

{oin '^)n>i <^ contraction of{an)n>i with scaling number 6*. In the other hand, ifs > r, then 6* > 
1 and then [an '^)n>i i^ <^ dilatation of{oin)n>i with scaling number 6*. Note that 6* does not depend 
on the parameter A of the exponential distribution. 

One shows below that the sequence (a^ '^)n>i, with 6* = (1 + s)/{l + r), satisfies the empirical 
measure theorem. 

Proposition 5.5. Let r, s > and let X be an exponentially distributed random variable with rate 
parameter A > 0. Assume (an)n>i i^ cin asymptotically -optimal sequence of quantizers for X and 
let {an '^)n>i be defined as before, with 6** = (s + l)/(r + 1). Then, the sequence [an satisfies 
the empirical measure theorem. 



Proof. Since (a^ '°)n>i = (^*an)n>i, It amounts to show that 

card(a„,n [a/^^6/e*]) 1 



n Cf^s Ja 

i.e that for all a, 6 G M+, 

1 1 1 . 1 



f{x/9*)^+^dx = — — / f{x)^+'dx. 



Cf^r G* J a Cf^s J a 

Elementary computations show that V r > 0, 

C/,r = A-T*^(l + r). 



so that 



1 1 + r , _A 3_ 



A—-— / (Xe-^-^y" dx 



1 _L 

= 7^— / f{x)^+''dx. 

^f,s J a 

□ 

0^ \ I 

Is the sequence {an ' )n>i asymptotically L*-optimal? The remark [5^21 is also valid for the ex- 
ponential distribution. Our upper bounds in (|3.3p and p.7p do not allow us to show that is 
asymptotically L*-optimal because of the corollary below. But the numerical results strongly suggest 
that it is. 
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Corollary 5.2. Let X <^{X) and 9* = {s + l)/(r + 1). Then, 

Qs{Pf' < liminf n^/'^\\X - < limsupn^/'^ \\X - < (P,^)^/" (5.6) 

with 

^'■'^^ \ (s + l)i+V^((r + l)AiT^)^'C(6)i/« ifs>r. 

Proof. We easily prove, like in proposition 15 .21 that Q^^l{P,6*) = Qs{P)- The corollary follows 
then from ()2.ip and ()4.2p (keep in mind that for all r > 0, Jr,i = (.^+1)2'- )• '-' 

5.2.2 Numerical experiments 

For numerical examples, Table |2] gives the regression coefficients we obtain by regressing the 
grids onto the grids we get with the and norms, for different values of n. The notations are 
the same as in the previous example. We note that for large enough n, the coefficients cigr tend to 
(s + l)/(r + 1) = 9*. For example, if n = 900, we get ai2 = 0.6676880; 042 = 1.6640023 whereas 
the expected values are respectively 2/3 = 0.66666667 and 5/3 = 1.6666667. The absolute errors 
are in the order of 10~^. Like the Gaussian case, we remark that the error of the estimation results 
mainly from the tail of the exponential distribution. 



n 


ai2 


bi2 


e 




«42 


bi2 


e 


20 


0.6765013 


-0.0104881 


0.0019489 




1.6396807 


0.0288348 


3.081E-33 


50 


0.6726145 


-0.0082123 


0.0045310 




1.6502245 


0.0225246 


1.149E-28 


100 


0.6706176 


- 0.0062439 


0.0070734 




1.6556979 


0.0172020 


1.573E-27 


300 


0.6686428 


- 0.0036234 


0.0114628 




1.6611520 


0.0100523 


1.508E-27 


700 


0.6677864 


- 0.0022222 


0.0146186 




1.6635261 


0.0061356 


1.222E-25 


800 


0.6676880 


- 0.0020482 


0.0150735 




1.6638043 


0.0057199 


2.020E-26 


900 


0.6676079 


- 0.0019043 


0.0154634 




1.6640023 


0.0053173 


9.683E-25 



Table 2: Regression coefficients for exponential distribution. 



Conjecture 2. Let X be an exponentially distributed random variable with rate parameter A and let 

{oin)n>i be 0^1^ L'' -optimal sequence of quantizers for X. Then for s > and 9* = {s + \)/{r + 1) 
the sequence ''')n>i i^ asymptotically L'^ -optimal. 

These exampless could suggest that a contraction (or a dilatation) parameter 9*, solution of the 
minimisation problem ()5.ip . always leads to a sequence of quantizers satisfying the empirical measure 
theorem. The following example shows that this can fail. 

5.3 Gamma distribution 

5.3.1 Optimal dilatation and contraction 

Proposition 5.6. Let r, s > and let X be a Gamma distribution with parameters a and A : X ~ 
r(a,A), a > 0, A > 0. 
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(a) if s E (r, r + 1), the sequence {an^)n>i is L'^ -rate-optimal iff 6 ^ {s/(r + 1), +oo) and for 
all a > 0, 

r = {s + a)/{r + a) 
is the unique solution of ()5.ip on the set (^s / {r -\- \), -\-oo) . 

(h) if s > r + 1 and if a € (Oi sequence (an°)„>i is L"^ -rate-optimal for every 

9 G (s/(r + 1), +CX3) and 

r = (s + a)/(r + a) 

w f/ze unique solution of (|5.ip on ^/ze ^ef (s/(r + 1), +oo) (Note that the assumptions imply 
ae{0,2)). 

(c) ifs < r, the sequence (an^)n>i is -rate-optimal for every 6 € (s/r, +oo) and for all a > 0, 

r = (s + l)/(r + l) 
w f/ie unique solution of (|5.ip o?i f/ze i'ef (s/r, +oo). 

Proof. We set f^i = 0. Keep in mind that the density function is written 

\ a r+oo 

fix) = x'^-ie-^n|,>o}, with r(a) = / x'^-^e-^dx. 
J- Jo 

(a) and (b). Let s € (r, r + 1) and set i?o = max(0, (a — 1)/A). The function / is decreasing 
on (i?05+oo) and for every 9 > 0,fi, the couple {9,fi) is P-admissible. For 9 > s/{r + 1), As- 
sumption p.lOp holds true for every c G (l, 9{1 + r)/s). Moreover, Hypothesis (HI) clearly holds. 
Consequently, it follows from Corollary 13.1 [ (a) that Assumption p.6p of Theoreme 1 3 . 2 1 holds true. 

When s > r + 1, the additionnal hypothesis G ^od^) ^olds for a < ^ + 1. Note that 

if P = / . Ad then Ad(supp(P) n {/ = 0}) = implies that Arf(- n supp(P)) < P. It follows that 
(H3) holds. In this case Assumption p.6p of Theoreme 13 . 2 1 holds true. 

For all 9>0, 

\ l-s/(r+l) /.+00 







and then 



/ f{9x)f{x) ^dx<+oo iff 9 > s/{r + 1) and a{r + l-s) + s>0. 
Jr 

Let 9 > s/{r + 1). Then 
9'+^ f(9x)f(x)-TT^dx = (-^] 9'+^9^-^ x('^-^)(^-iT^)e-(''"ii^)^"dx 

Jr Vr(a)y Jo 

with 

7 = s + a and /3 = (a - 1)(1 - s/(r + 1)) + 1. 
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We define on the function h by 

The function h is differentiable for all > s/(l + r) and 

= -I (,__^)-^-'((,_ ,),__£2_)^ 

Hence, the minimum of h is then unique on (s/(r + 1), +00) and is reached at 6*. 

Notice that the condition required for f~~ to be in L\^^{P) is a < ^^-^ + 1 and for every 
s > r + 1 one has 1 + ^^-i^ < ^_^^_^-^y Combined to the condition a(r + 1 — s) > yields the 
condition for a. 
(c) Let s < r. Then 

Jr r(a) Jo 

r s 

Therefore j^f^-^{6x)f ^-^{x)dx < +00 iff 9 > s/r. 
Let 9 > s/r. Then 



Considering the function ft, defined by h{9) = 9^'^'^ {r9 — s)"'~ we show that h reached its minimum 
on (s/r, +00) at the unique point 6* = {s + a) / {r + a). 

□ 

Remark 5.4. Let X ^ r(a,A). If s < r, then 9* = {s + a)/{r + a) < I. Then the se- 
quence {an '^)n>i is <3 contraction of {an)n>i with scaling number 9*. On the other hand, if 
s > r, then 9* > 1 and the sequence {an '^)n>i <^ dilatation of (a„,)„>i with scaling num- 
ber 6*. Moreover there is no constraint on the parameter a as long as s < r + \. In this case when 
we set a = 1 (exponential distribution with parameter \) we retrieve the result of the exponential 
distribution. Note that 9* does not depend on the parameter X. That is expected since T{1, A) = (o'(A) 
and, in the exponential case we know that the scaling number does not depend on A. 

Let 0* = (s + a)/(r + a) and consider now the sequence {an '^)n>i defined as previously. Does 
this sequence verify the empirical measure theorem? If o = 1 we boil down to the exponential 
distribution. On the other hand, when a / 1, one shows below that there exists a > 1, s > and 
r > such that the sequence {afi '^)n>i does not verify the empirical measure theorem. 

Suppose that {an '^)n>i satisfies the empirical measure theorem. Then we must have, for all 
u G M+, 

7^^/ f{^in^dx = -— f{x)—sdx. (5.7) 

^f,r ^ Jo ^f,s Jo 
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with f{x) = |^3;"~^e~-^^l|^>o} ^^d Cf^r = J f{x)^+^dx for all r > 0. 
Moreover, let r > 0. Then, 



1 t ' "-^ ^ 



JO 



Ai+^^r(a)~i+^^r 

V + a 



A '■+1 (r + 1) '■+1 

r + 1 / 



r + 1 



1 r , , r+g 

r(a) i+'-A '■+! (r + l) '■+1 . 



Equation (j5.7p is written down for all u G M+, 



r + a \ '■+1 



s + a 



''■+1, Vr>0. 



with C(r) = r (^^) ^A^(r + 1)' 

Let m G N and a > 0. We show by induction that, for u > 0, 



f 

Jo 



,n-2 



n! 



n+l ■ 



Consider a > 1 such that ^tt and ^tt- are integers. Set n — , , 

r+l s+1 r+1 

. Then Equation (|5.7p is finally written down 



'^-1 rn = ^,a= and /? 



(r+l)(s+a) 



C(r) 



s + a 



n ^ 1) 



a 

m m{m — 1) 



n! 



+••• + — w + 



n! 



-I 7/"'~^ + 



m! m! 



n+l 



n! 



n+l 



/?3 



^"1-2 _^ ^ ^ _^ 



-/3ti 



m! 



m+l 



Set a = 7, s = l, r = 2, A = l and u = 1. Then n = 2, m = 3, a = 3/8, (3=1/2 and this lead, 
after some calculations to : 

128 48 512' 

which is clearly not satisfied. We then deduce that for (a, r, s) = (7, 2, 1), the sequence {an '^)n>i 
does not satisfy the empirical measure theorem. Hence, we have constructed an -rate-optimal 
sequence which does not satisfy the empirical mesure theorem. 
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